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DETAILED ACTION 



Claim Rejections - 35 USC § 103 
1. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

1. Claims 1, 5, 8-9, 11-12, 14-20, 24, 26, 29-30, 32, and 37 rejected under 35 U.S.C. 103(a) 
as being unpatentable over Ejiri et al (US 5,969,969) in view of in view of Kumamoto Kenji (JP 
10-257482). 

Re claims 1 and 37, Ejiri teaches a vehicle-operation assist for a vehicle (100 of figs. 33 
and 37) mounted with a camera (120, 124 of fig. 33), said vehicle operation assist comprising: an 
imaging unit (120, 124, 125 of fig. 33) operable to generate a circumferential state image using 
an output image fi*om the camera (124 of fig. 33), said circumferential state image viewed fi'om 

synthetic-image generating unit (1 17 of fig. 33) operable to generate a synthetic image 
using the circumferential- state image (126a, 1 15a of fig. 33) and an assumed-movement pattern 
image (1 14b and 1 16c of fig. 33) which is based on a driving operational (130 of fig. 33) of the 
vehicle and a display unit (160 of fig. 33) operable to display the synthetic image wherein said 
synthetic image shows a fijture movement of the vehicle along a predetermined path between a 
starting point and an ending point when parking the vehicle (fig. 39); see also figs. 37-40. 

It is noted that Erjiri does not particularly teach a virtual viewpoint, said virtual viewpoint 
being different fi:-om a viewpoint of the camera as claimed. 
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However, Kenji teaches the synthetic image (42 of fig. 5-8) showing the car (46 of fig. 5) 
from a virtual point of view as three dimensional space (8 of fig. 8) that is converted from the 
actual viewpoint (6, 10, 1 1, 14, and 15 of fig. 2; 37 of fig. 3) so this suggests a virtual viewpoint 
as a three-dimensional space, said virtual viewpoint being different from a viewpoint of the 
camera. 

Therefore, taking the teachings of Erjiri and Kenji as a whole, it would have been 
obvious to one skill of ordinary skill in the art to incorporate the teachings of Kenji into the 
image processing apparatus of Eijiri for displaying a generated synthetic image showing the 
vehicle from a virtual point of view using the real image captured from cameras. 

Doing so would provide an always clean car circumference image can be seen by 
detecting the variation rate of the car body by the irregularity of a road surface by the 
acceleration sensor, feeding back to a display image, and removing the shake of an image. 

Re claims 5, 8, 9, Erjiri further teaches the circumferential state image viewed from a 
predetermined viewpoint as a point fixed three-dimensional space or the vehicle (fig. 39), and the 
viewpoint converting unit is included that changes the predetermined viewpoint automatically or 
through an input from a driver (1 18 of figs. 33 and 37); wherein the assumed-movement pattern 
image includes virtual poles arranged on the outer edge of the vehicle movement area (A, B, C, 
and D of fig. 39); the synthetic-image generating unit superimposes a current-position camera in 
which the vehicle is present, on the circumferential-state image to generate the synthetic image 
(Dand Aoffig. 39). 
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Re claims 1 1 and 12, Erjiri further teaches wherein when actual driving operations 
corresponding to predetermined series of driving operations are started (130 of figs. 33 and 37; 
see also fig. 38), the synthetic-image generating unit fixes positional relation between the 
assumed-movement pattern image and the circumferential-state image at the point of time when 
the actual driving operations are started and generates the synthetic image (706, 707 and 708 of 
fig. 38); a positional-information storing unit is included which stores positional: information of 
the whole or a part of the assumed-movement pattern image with regard to the whole or a part of 
the video data for the circumferential-state image on the synthetic image when 'the actual driving 
operations are started (116 of figs. 33 and 37), and; the synthetic-image generating unit (1 17 of 
figs. 33 and 37) fixes the positional relation in accordance with the positional information. 

Re claims 14-20, Erjiri further teaches wherein a final-position inputting unit for 
inputting a final position which is a position of the vehicle at end of the movement and a start- 
position determining unit for obtaining a start position which is a position at start of the 
movement corresponding to the input final position in accordance with the-an assumed- 
movement pattern are included (709 of fig. 38), and the synthetic-image generating unit 
superimposes the input final position and the start position corresponding to the input final 
position on the circumferential-state image to generate the synthetic image (fig. 39); a start- 
position guiding unit (1 18a of fig. 33 and 37) is included which guides the vehicle to the start 
position by automatically controlling driving of the vehicle; an assumed-movement-pattem 
storing unit (1 16b of figs. 33 and 37) holds a plurality of assumed-movement patterns; the 
assumed-movement-pattem storing unit holds a plurality of assumed- movement patterns (1 16b 
of fig. 33 and 37), and a pattem selecting unit (118 of figs. 33 and 37) is included which 



Application/Control Number: 09/58 1 ,004 Page 5 

Art Unit: 2613 

automatically selects the assumed- movement pattern through an input from a driver or a 
predetermined driving operation; wherein the pattern correcting unit (709, 710, and 711 of fig. 
38) is included which updates and corrects content of the assumed-movement pattem stored in 
the assumed- movement-pattern storing unit; wherein the pattem correcting unit updates and 
corrects the assumed- movement pattem (140 of fig. 37, Note updates and corrects the current 
positions of the vehicle) in accordance with the vehicle positions at start and end of the corrected 
movement input from a driver (NOTE the guidance information selector (1 18of figs. 33 and 
37)then selects the most proper guidance information (1 18a of figs. 33 and 37) for the driver 
from the viewpoint of safety, allowance, etc. according to whether or not it is possible for the 
driver to judge the information subjectively. The selected result is output onto the display imit 
(160 of figs. 33 and 37), such as an instrument panel, console panel and so on); wherein the 
pattem correcting unit updates and corrects the assumed- movement pattem in accordance with 
an actual driving operation (. 

Re claims 24, 26, 29, 30, and 32, Erfiri fiirther teaches wherein when the viewpoint 
converting unit changes the predetermined viewpoint, the viewpoint converting: imit fixes the 
predetermined viewpoint to the vehicle before the actual driving operations corresponding to the 
predetermined series of driving operations are started (fig. 40) and wherein the assumed- 
movement pattem image includes a circumscribed area on a space through which the vehicle 
passes when the predetermined series of driving operations are performed (fig. 39); wherein the 
assumed-movement includes a change from a backward movement to a forward movement or 
from a forward movement to a backward movement in the predetermined series of driving 
operations (fig. 40); wherein an obstacle inputting unit is included which is able to input a 



Application/Control Number: 09/5 8 1 ,004 Page 6 

Art Unit: 2613 

position of an obstacle area in an image to the display unit for displaying the synthetic image( 
fig. 34, elements x and 100b); wherein the pattern correcting unit updates and corrects the 
assumed-movement patterns in accordance with a position of an obstacle area input fi"om a driver 
(JUDGMENT of fig. 35). 

Conclusion 

2. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
AppUcant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi'om the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated fi"om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS firom the date of this 
final action. 

Contact Information 

Any inquiry concerning this communication or earlier communications firom the 
examiner should be directed to Tung Vo whose telephone number is 571-272-7340. The 
examiner can normally be reached on Monday-Friday. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on 571-272-7418. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free)^- 

Tung Vo 
Primary Examiner 
Art Unit 2613 



